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ABSTRACT 


s  Several  algorithms  are  given  for  finding  a  critical  subset  S  determined  by  a  binary  monotonic  set 
function  over  a  given  set  U .  A  set  5  is  critical  iff  /  ( T )  =  1  for  all  T  such  that  S  C  i  T  and 
/  (R )  =  0  for  all  R  such  that  R  C  S .  Upper  bounds  on  the  worst  case  times  for  the  algorithms,  deter¬ 
mined  by  the  number  of  calls  to  the  binary  set  function,  vary  downwards  from  2r  flga  m ]  f unction  calls. 
Here  n  is  the  size  of  U  and  r  is  the  size  of  the  critical  set  found.  We  find  that  the  conceptually  easiest 
algorithm  is  not  the  easiest  to  program  and  also  that  the  algorithms  with  better  upper  bounds  fare  more 
poorly  in  practice,  based  on  a  small  sample  of  random  trials.  Although  finding  one  critical  set  is  easy  we 
also  show  that  it  can  quickly  get  very  difficult  to  find  additional  critical  sets,  simply  because  it  can  be 


j  rue  r.  . 


1.  Introduction 


By  a  binary  monotone  set  function  we  mean  a  function  defined  on  the  power  set  of  set  U  such  that  if 
/  (5 )  =  1  then  /  (5,)  =  1  for  all  5 j  such  that  5  C  S,,  and  takes  only  0  and  1  as  values.  A  critical  act 
S  of  f  satisfies  /  (S )  =  1  and  /  (S2)  =  0  for  all  S2  such  that  S3  C  5 .  (We  use  C  for  “  C  and 
j^”.)  We  give  algorithms  for  finding  a  critical  set  of  /  (often  called  simply  “a  critical  set”  when  /  is 
understood);  using  at  most  2r  [If  n]  function  calls,  where  r  is  the  number  of  elements  of  the  critical  set, 
»  is  the  number  of  elements  in  the  given  domain  (“universe”),  fx)  is  the  least  integer  m  satisfying  m  >i, 
and  Ig  n  denotes  log2  n  .  After  presentation  of  the  algorithms  we  consider  implementation  of  the  algo¬ 
rithms  since  here  the  manner  of  implementation  affects  not  only  the  running  time  of  the  algorithm  but 
the  relative  ease  of  implementation  as  well.  Finally,  we  will  see  in  the  last  section  that  finding  another 
critical  set  can  get  very  difficult  quickly  (exponential  growth)  as  a  function  of  the  number  of  known  criti¬ 
cal  sets. 

The  problem  of  finding  critical  sets  arises,  for  example,  in  classification  networks  with  a  monotone  pro¬ 
perty.  Given  a  set  of  input  nodes  and  a  set  of  output  nodes  for  a  graph,  suppose  firing  certain  subsets  of 
input  nodes  are  supposed  to  result  in  one  output  per  subset  being  fired.  Also,  any  superset  of  a  valid 
input  fires  the  same  output  node.  Clearly,  firing  all  input  nodes  simultaneously  usually  leads  to  many 
output  nodes  being  fired.  Consider  minimal  input  sets  that  fire  two  or  more  output  nodes.  We  have 
interest  in  locating  these  minimally  ambiguous  nodes.  See  [l]  for  a  paper  that  reports  on  this  application, 
and  its  role  in  constructing  “expert  knowledge”  systems.  Abo,  a  use  for  a  generalisation  of  the  problem 
to  non-boolean  distributive  lattices  has  arisen  in  devising  tests  for  input  attenuation  values  in  networks 
abstracting  certain  expert  system  inference  systems  using  uncertainty. 

2.  The  algorithms. 

We  now  give  four  different  algorithms  to  solve  the  critical  set  problem,  each  of  independent  interest 
The  first  critical  set  algorithm  we  give  is  particularly  simple  conceptually  and,  on  occasion,  can  perform 
better  than  the  other  algorithms.  For  the  remainder  of  the  paper  we  will  assume  that  there  exists  at  least 


one  critical  set  for  the  monotone  set  function  f.  Note  that  this  is  determined  by  /  ([/)  =  i  Mud 
f  (  0  )  =  0,  where  U  is  the  universal  set.  We  represent  the  cardinality  of  set  5  by  |  S  \  . 

Algorithm  I 

{  Assumption:  a  critical  set  exists  } 

1.  k  —  1 
V‘*~U 

2.  Partition  U‘  into  roughly  equal  subsets  U  UU  it...,U  y, 

W  -  U‘ 

3.  For  «  «—  1  to  2k  do 

if  f(U‘-Ui)=  1  then  V  —  V*-Ut 

A.  If  max  |  Ui  |  =1  then  U‘  is  a  critical  set 
else  if  |  U  “  |  >  2  |  U  *  |  then  return  to  step  2 
else  k *-  min(  2k ,  \  U'  j )  and  return  to  step  2. 

The  phrase  “roughly  equal”  means  that  the  two  sets  differ  at  meet  by  one  in  cardinality. 

The  underlying  concept  is  best  seen  when  one  critical  set  C  <rf  r  elements  exists.  If  k  =  r  then  divid¬ 
ing  U  *  into  2r  equal  disjoint  subsets  allows  the  r  elements  of  C  to  be  in  only  half  the  subsets.  For  each 
Uf  containing  no  element  of  C ,  f  ( 1/ *-!/,• )  —  1  and  I/t-  may  be  removed  from  U* .  With  many  critical 
sets  present,  the  same  principle  works;  the  algorithm  "focusses  in”  on  one  critical  set  in  the  sense  that 
critical  sets  with  elements  in  (/,-  are  discarded  whenever  U-U{  contains  a  critical  set,  since  then 
/  (U -U;)  =  1.  The  evaluation  with  all  C/,-  equal  to  1  is  needed  to  confirm  that  one  actually  has  a  criti¬ 
cal  set. 


We  now  consider  an  upper  bound  on  the  number  of  function  calls  needed  by  this  algorithm  to  locate  a 
critical  set.  The  number  of  function  calls  is  the  appropriate  measure  when  the  function  evaluation  is  non- 
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trivial  because  the  rest  of  the  algorithm  processes  very  quickly.  If  the  elements  of  the  critical  set  of  size  r 
that  we  finally  locate  are  “equidistant”  from  each  other,  then  until  k  reaches  size  r  the  set  variable  U  * 
never  shrinks.  (  We  assume  that  r  and  n  are  powers  of  2  for  convenience.  )  Thus  0r  2*2'  <  41  og  r 
function  calls  are  made  before  the  if  condition  in  Step  3  is  met  for  the  first  time.  Thereafter,  with  Jt  —r 
throughout  the  remainder  of  the  run,  we  have  2r  (log  n  -logr )  function  calls  in  total  as  the  U  *  shrinks  by 
a  factor  of  2  for  each  execution  of  Step  3.  Combining  these  two  parts  we  have 
4log  r  -f  2r  log  n  -  2r  log  r 
<2r  log  n 

function  calls  needed  for  Algorithm  I. 

The  second  algorithm  takes  the  depth-first  approach  which  allows  us  to  set  tighter  upper  bounds  con¬ 
veniently.  Here  we  repeatedly  find  one  element  of  the  critical  set  at  a  time,  and  doing  this  by  continual 
binary  splitting  of  the  space  under  consideration.  Three  set  variables  are  important:  C  retains  known 
members  of  the  critical  set  being  isolated,  A  includes  at  least  one  element  of  the  critical  set  being  iso¬ 
lated,  and  R  includes  the  remaining  unknown  members  of  that  critical  set.  Correctness  follows  from  the 
fact  that  whenever  A  is  non-empty  then  A  must  contain  members  of  the  critical  set  being  isolated. 

Algorithm  II 

{  Assumption,  a  critical  set  exists  } 

1.  C  ♦—  t 
A  -  U 
R  -  I 

2.  Split  A  into  roughly  equal  disjoint  sets  A  i  and  A  2  such  that  |  A  t  |  <  |  A  2  | 

3.  If  /  (C  U  R  U  A ,)  =  I  then  A  —  A , 

else  {  A  2  contains  elements  of  the  critical  set  being  isolated  } 

R  —  A,  U  R 
A  *—  A  2 


o 


4.  If  |  A  |  >  1  then  return  to  step  2 
else  {  an  element  of  the  critical  set  is  isolated  } 

C  «-  A  U  C 
A  +-R 
R  ^9 

if  A  =  9  then  C  is  a  critical  set 
else  return  to  step  2 

The  inequality  in  Step  2  assures  the  proper  handling  of  the  case  |  A  |  =1.  It  is  important  but 
straightforward  to  notice  that  C  is  a  critical  set  at  termination  without  checking  C  explicitly. 

An  upper  bound  of  rlog  »  function  calls,  where  r  is  the  number  of  elements  in  the  critical  Bet  found, 
follows  directly  from  the  depth-first  nature  of  the  algorithm. 

We  are  able  to  construct  a  variant  of  Algorithm  II  that  gives  a  better  upper  bound  for  large  r,  that  is, 
that  seems  better  when  the  critical  set  found  is  large.  We  note  that  these  algorithms  tend  to  find  small 
critical  sets  so  that  most  critical  sets  of  a  function  must  be  large  to  have  the  critical  set  found  be  large. 
However,  since  the  bound  is  as  good  uniformly  as  that  for  Algorithm  1  and  very  good  when  large  critical 
sets  are  found,  which  is  when  computational  efficiency  really  matters,  this  algorithm  definitely  is  interest¬ 
ing. 


This  algorithm  is  seen  to  differ  from  the  previous  algorithm  primarily  in  the  first  portion  where  we 
“grow”  an  interval  first. 


Algorithm  III 

{  Assumption:  a  critical  set  exists  } 

1.  R  —  U 

C 

2 .  S  —  some  subset  of  R  of  site  2 

i  —  1 

3.  While  /  (Cufl-S)=  1  do 

R  *-  R-S 

S  *—  some  subset  of  R  of  sise  2' 

•  «—  i  +1 

4.  A  —5 

R  —  R-S 

5.  Split  A  into  roughly  equal  disjoint  sets  A  j  and  A*  such  that  1  A  i  |  <  |  Aa  | 

6.  If  /  (C  U  R  U  A  j)  =  1  then  A  *-  A  , 

else  {  A  2  contains  elements  of  the  critical  set  being  isolated  } 

R  *-  Ai  U  R 
A  4 —  A  j 

7.  If  |  A  |  >1  then  return  to  step  5 

else  {  an  element  of  the  critical  set  is  isolated  } 

C  —  A  U  C 
A  —  R 
R 

if  A  =  #  then  C  is  a  critical  set 


else  return  to  step  5 
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To  compute  a  bound  on  the  number  of  function  calls,  we  consider  the  effect  of  pruning  the  space  with 
the  sets  of  increasing  size,  as  done  in  steps  1-4.  Let  tk  be  the  size  of  the  set  which  cannot  be  discarded  in 
the  attempt  to  find  the  k  th  element  of  the  critical  set  (  so  is  the  size  of  the  set  assigned  to  variable  A 
at  step  4),  and  let  r  be  the  number  of  elements  of  the  isolated  critical  set.  Then  there  are  log  function 
calls  during  the  discovery  of  the  set  of  size  and  the  same  number  of  calls  to  isolate  the  critical  element 
in  that  set.  Thus  we  can  bound  the  number  of  calls  by 

£/-i21°g  *i  ■ 

If  we  represent  our  universe  as  a  binary  vector  and  choose  the  elements  of  our  critical  set  at  positions 
t*(n  / r )  for  i=l,...,r ,  which  is  the  worst  case  critical  set  of  r  elements,  then  «,  =  n  /r  and  the  number 
of  function  calls  is 

2log  n  /r  —  2r  log  n  jr  . 

If  r  =  ca ,  for  e  <  1,  then  we  have 

2c*  log  1/e  =  Cn  ,  for  some  C . 

In  particular,  if  r  —  *  /2  because  all  critical  sets  are  that  size  or  greater,  then  the  number  of  function 
calls  is  bounded  by  *  ,  a  nice  consequence  because  it  is  clear  intuitively  that  when  r  is  close  to  n  (and  this 
is  known)  then  the  best  thing  to  do  is  to  test  /  ( U-e )  for  each  element  e  of  the  universe,  performing 
U *—U-e  whenever  the  function  evaluation  is  1,  to  obtain  the  critical  set  directly.  This,  of  course,  takes 
n  function  calls. 

The  fourth  algorithm  is  basically  a  depth-first  algorithm  like  Algorithm  II,  with  the  primary  difference 
the  intr  Auction  of  a  stack  to  retain  sets  known  to  contain  points.  The  stack  provides  much  more  struc¬ 
ture  to  the  residual  set  R,  often  shortening  the  search  for  the  next  critical  set  element.  The  set  R  is 
defined  to  be  the  union  of  sets  on  the  stack.  Although  the  stack  device  works  equally  well  on  Algorithm 
II,  the  symmetric  check  of  both  halves  of  the  split  is  more  natural  when  the  stack  is  used. 
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Algorithm  IV 

{  Assumption:  a  critical  set  exists  } 

1.  C  -# 

A  U 

empty_stack_R  «—  true 

2.  Split  A  into  roughly  equal  disjoint  sets  A  t  and  A  s 

3.  If  /  (C  U  R  U  A  ,)  =  1  then  A  *-  A  t 
else 

if  /  (C  U  B  U  A  2)  =  1  then  A  —  A  2 

else  {  both  A  ,  and  A  2  contain  elements  of  the  critical  set  being  isolated  } 
push_R  ( A ,) 

A  <~AS 

4.  If  |  A  |  >1  then  return  to  step  2 

else  {  an  element  of  the  critical  set  is  isolated  } 

C  «-  A  U  C 

if  empty_stack_R  then  C  is  a  critical  set 
else  pop _R(A  )  and  return  to  step  4. 

It  is  again  important  but  straightforward  to  notice  that  C  is  a  critical  set  at  termination  without 
checking  C  explicitly.  Here  the  manner  of  splitting  A  when  |  A  |  is  odd  is  unimportant. 


The  number  of  function  calls  used  here  is  bounded  by  2r  log  n ,  an  easy  upper  bound  because  there  are 
r  elements  to  our  isolated  critical  set,  each  using  at  most  21og  n  function  calls  to  be  isolated.  Although 
this  bound  is  approachable  for  very  small  r ,  (e.g.  r  —1  ),  in  general  the  use  of  a  stack  provides  much 
better  performance,  as  we  amplify  in  the  next  section. 


■ 

r- 


r/ 

r„" 

« 
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3.  Remarks  on  implementations. 

The  four  above  algorithms,  and  several  variants  thereof,  were  implemented  to  observe  relative  perfor¬ 
mance  qualitatively,  to  allow  some  idea  of  performance  relative  to  the  upper  bounds  determined  above, 
and  to  see  if  there  were  any  lessons  to  be  learned  regarding  implementation.  There  were  interesting  obser¬ 
vations  in  all  these  regards. 

The  first  attempt  to  implement  the  algorithms  was  undertaken  in  PASCAL  (as  were  all  subsequent 
implementations)  with  use  of  the  PASCAL  set  type,  a  data  type  allowing  the  manipulation  of  sets  directly 
as  primitives,  with  the  set  algebra  operations  and  the  membership  relation.  The  first  programs  were 
obtained  using  a  direct  translation  of  the  algorithms  into  PASCAL  using  this  data  type.  Some  trial  runs, 
over  a  space  of  2048  elements  and  a  random  mix  of  binary  functions,  revealed  a  worse  time  than  predicted 
and  with  Algorithm  I  far  superior  to  Algorithm  IV,  the  only  other  algorithm  first  programmed.  The  prob¬ 
lem  was  immediately  discernible.  For  this  implementation  approach  the  partition  step  (step  2  in  both 
Algorithms  I  and  IV)  takes  O  (n )  time  because  the  only  general  way  to  partition  a  set  is  to  test  member¬ 
ship  using  the  membership  relation,  and  to  sweep  the  entire  universe.  (Again,  n  is  the  universe  site  ) 

* 

While  generally  costly,  it  was  much  less  costly  for  Algorithm  I  than  for  the  others  because  it  is  as  easy  to 
split  into  2k  sets  as  to  split  into  two  sets.  An  order-of-magnitude  argument  shows  this  nicely,  as  we  now 
show . 

We  consider  the  running  time  of  Algorithms  I  and  IV'  under  the  assumption  that  computation  erf  the 
binary  set  function  is  fast,  indeed  a  unit  operation  (perhaps  not  realistic  in  most  cases,  but  nearly  true  in 
our  test  runs).  Roughly,  Algorithm  I  partitions  a  set  0(log  n)  times,  the  partition  costing  O(n)  time 
and  step  3  costing  O(r)  time  (at  most).  Thus  the  co6t  is  bounded  by  0((n  +r)log  n  )  effort.  For  Algo¬ 
rithm  IV  the  number  of  partitions  is  roughly  the  number  of  function  calls  and  thus  the  total  effort  is 
closer  to  O  (nr  log  n  ).  Algorithms  II  and  HI  clearly  behave  as  Algorithm  IV  does. 

However,  there  is  another  approach  to  implementing  Algorithm  IV,  actually  the  implementation 
intended  when  Algorithm  IV  was  designed,  that  turned  out  to  be  beneficial  to  all  algorithms.  The  idea  is 
to  use  intervals  to  define  the  primitive  sets,  i.e.  to  consider  elements  as  numbered  from  1  to  n  and  use 


ordered  pairs  of  numbers  to  specify  end  points  of  all  numbers  in  a  primitive  set.  In  fact,  we  learned  that 
PASCAL  permits  the  construct  (a.. 4  ]  to  denote  the  “interval  set”  defined  by  variables  a  and  b  ,  thus  per¬ 
mitting  a  calculus  of  intervals  within  the  PASCAL  set  type  domain.  The  beauty  of  the  interval  notation  is 
that  partitioning  a  set  into  two  “equal”  parts  is  a  matter  of  computing  a  midpoint  of  an  interval,  a  unit 
operation.  Moreover,  in  Algorithm  IV  the  intervals  are  adjacent  in  R  so  that  R  (the  union  of  sets  on  the 
stack)  remains  a  single  interval  throughout  the  entire  computation.  Algorithm  I  gained  some  speed  by  this 
move  but  because  any  partition  set  could  be  eliminated,  the  universe  quickly  became  complex  and  parti¬ 
tioning  required  a  non-trivial  program,  although  O  (r )  rather  than  0  (n  )  steps  are  needed. 

We  take  our  actual  running  times  with  a  barrel  of  brine  because  there  is  no  manner  in  which  to  charac¬ 
terize  “typical”  monotone  binary  set  functions,  or  to  envision  likely  application  structures.  (In  the  appli¬ 
cation  that  led  to  the  investigation  of  this  problem  there  seems  to  be  few  critical  sets  when  there  exist 
any.)  We  used  a  space  of  512  elements  with  binary  functions  that  defined  up  to  16  critical  sets  generated 
randomly  regarding  aise  and  location,  under  obvious  constraints.  The  critical  sets  were  both  specified  by 
randomly  chosen  points  or  randomly  chosen  intervals,  with  cardinality  from  1  to  450,  although  ranges 
were  usually  restricted  to  a  narrower  band  than  that.  What  we  are  willing  to  note  is  that  all  algorithms 
ran  well  below  their  computed  bounds  in  number  of  function  calls,  and  that  Algorithms  I  and  IV  almost 
uniformly  beat  the  other  algorithms,  many  times  by  a  factor  of  two  or  more,  but  many  times  the  differ¬ 
ence  was  less.  Recall  that  Algorithm  II  does  not  incorporate  a  stack  for  R;  with  such  a  stack  it  would  per¬ 
form  comparably  to  Algorithm  IV.  Algorithm  IV  was  almost  always  the  winner  but  usually  by  10%  or  less 
over  Algorithm  I.  Examples  exist  where  each  of  these  two  algorithms  severely  beat  the  other.  All  algo¬ 
rithms  ran  quickly  so  that  the  computation  time  would  be  in  the  evaluation  of  the  function  in  most  appli¬ 
cations. 

We  judge  Algorithm  IV'  the  winner,  primarily  on  the  ease  of  programming  the  interval  version  discussed 
above,  but  also  because  it  slightly  outperformed  the  next  best  algorithm  on  the  average.  The  use  of 
stacks  to  retain  partially  selected  sets  clearly  aids  efficiency  in  depth-first  implementations.  The  primary 
surprise  at  first  was  that  a  combination  of  Algorithm  IV  with  the  front-end  of  algorithm  ID  (that  elim¬ 
inated  ever-increasing  intervals)  performed  less  well  than  either  of  Algorithm  I  or  IV,  although 
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performance  was  comparable  when  all  critical  seta  were  large.  The  reason  seems  to  be  that  the  symmetric 
check  is  largely  wasted  when  the  intervals  u  t  preprocessed  for  relevance,  which  is  what  the  front>end 
accomplishes. 

It  is  always  interesting  to  note  when  examples  with  better  analytic  upper  bounds  fare  less  well  than 
algorithms  with  poorer  analytic  upper  bounds.  Algorithm  III  looks  best  from  upper  bound  considerations 
alone  but  generally  faired  poorly  in  comparison  with  two  other  algorithms. 

4.  Finding  many  critical  sets. 

The  critical  set  algorithms  find  only  one  critical  set  although  in  general  a  monotone  function  defines 
many  critical  sets.  How  are  (the)  others  found?  It  is  clear  that  a  second  critical  set  can  be  found,  if  one 
exists,  by  taking  each  element  c  of  the  first  critical  set  in  turn  and  evaluating  /  (17  -  {e  }).  If  the  value 
1  is  returned  for  any  such  e  then  a  new  critical  set  exists  as  a  subset  of  U  -  {c  }.  Then  U  -  (c  }  is  to  be 
used  as  the  new  universe  to  find  a  new  critical  set. 

In  general,  suppose  k  critical  sets  are  already  discovered  and  we  wish  to  know  if  there  is  a  k  +lrt  and, 
if  so,  to  be  given  a  set  containing  the  k  +lu  critical  set  (a  containment  set)  not  containing  any  of  the  k 
known  critical  sets.  Let  5,-  denote  the  iu  known  critical  set  with  5,-  =  {e,j,...,c,>  },  and  suppose  all 
these  sets  are  pairwise  disjoint.  Then  it  suffices  to  consider  the  sets  C„  =  {e,y|(  },  where 

I  <  )i  <  ri  ■  (Here  a  =/,  /2  '■'/*■)  If  e*ch  rf  —  k  then  there  could  be  k*  C0’s  to  consider.  That 
is,  /  (U  -  Ca)  might  need  to  be  evaluated  for  all  possible  Consider  the  following.  Suppose 
V  -  =  U  -  Ctto)  is  a  critical  set  for  some  fixed  integers  jk  satisfying 

<  k  =  ff  ■  If  the  S,- ,  1  <  i  <  k ,  are  all  found  first  (a  good  possibility)  then  it  could  take  t*  -  1 
function  calls  of  form  /  ( U  -  Ca),  where  each  returns  0,  before  /  ( U  -  CaJ  is  evaluated  with  value  1 
returned.  Thus,  the  problem  of  finding  a  set  that  contains  only  new  critical  sets  can  be  extremely  costly 
even  when  only  one  more  critical  set  exists.  We  emphasise  that  the  complexity  of  finding  a  critical  set  is 
a  function  of  the  number  of  critical  sets  already  found;  the  first  critical  set  is  not  hard  to  find. 

We  close  with  a  further  observation.  It  might  be  possible  to  devise  another  type  of  algorithm  that 
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would  yield  all  critical  seta  quickly,  without  having  to  find  new  containment  seta.  However,  an  argument 
baaed  on  the  same  principle  as  above  shows  that,  if  function  calls  are  the  only  source  of  information  used 
to  find  critical  sets,  then  finding  critical  seta  has  to  be  hard.  For  an  n  element  universe  Q(2*/n )  func¬ 
tion  calls  can  be  needed  just  to  determine  the  number  of  critical  sets,  or  to  determine  the  critical  seta  in  a 
case  when  the  description  of  the  class  of  critical  seta  is  very  straightforward.  Let  a  k-set  mean  a  set  with 
k  elements.  Then  the  description  of  a  critical  set  class  hard  to  confirm  is  “the  class  of  all  n/2-sets’’. 

We  outline  the  argument  for  the  above.  Let  V  have  n  elements.  Let  H  denote  the  class  of  all  n/2- 
sets  and  for  each  h  <£.  H  consider  a  monotonic  function  f  k  on  U  such  that  every  set  in  H  -  {A  }  is  a 
critical  set  but  h  is  not.  I.e.,  /*(h  )  —  0.  There  are  0(2*  /n )  such  /  *  since  J  H  |  =  0(2*  /n  ).  But  we 
note  that  for  all  5  C  U  such  that  |  S  |  >  */2  +  lw e  have  /»(S)  =  1  because  5  contains  an  n/2-set 
different  than  A .  Also,  /*  (5)  =  0  for  all  S  C  U  such  that  |  S  |  <  n  /2  -  1.  These  hold  indepen¬ 
dently  of  the  choice  of  A .  Thus,  only  function  calls  for  n/2-sets  can  yield  information  and  there  is  no 
dependency  between  n/2-sets  regarding  /  values.  Therefore  at  least  2*  /%  function  evaluations  may  be 
needed  to  determine  if  some  n/2-set  is  not  a  critical  set  or  if  indeed  all  n/2-sets  are  critical  sets.  In  the 
latter  case  there  is  one  more  critical  set  than  otherwise.  This  simultaneously  illustrates  that  the  determi¬ 
nation  of  the  fact  “all  n/2-sets  are  critical  sets’’  is  hard  and  determination  of  the  number  of  critical  sets  is 
hard  This  is  what  we  wished  to  show. 
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